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Abstract 

We study the space of all compact structures on a two-dimensional square 
lattice of size N = 6x6. Each structure is mapped onto a vector in N- 
dimensions according to a hydrophobic model. Previous work has shown that 
the designabilities of structures are closely related to the distribution of the 
structure vectors in the ^-dimensional space, with highly designable struc- 
tures predominantly found in low density regions. We use principal compo- 
nent analysis to probe and characterize the distribution of structure vectors, 
and find a non-uniform density with a single peak. Interestingly, the principal 
axes of this peak are almost aligned with Fourier eigenvectors, and the cor- 
responding Fourier eigenvalues go to zero continuously at the wave-number 
for alternating patterns (q = ir). These observations provide a stepping stone 
for an analytic description of the distribution of structural points, and open 
the possibility of estimating designabilities of realistic structures by simply 
Fourier transforming the hydrophobicities of the corresponding sequences. 
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I. INTRODUCTION 



Proteins fold into specific structures to perform their biological function. Despite the 
huge diversity in their functions, evolutional paths, structural details, and sequences, the vast 
majority of proteins adopt only a small number (~ 1000) of folds ( "topology" ).0iffiill This 
observation has intrigued a number of authors and lead to the concept of designabilityB 
The designability of a structure is defined tobe the number of sequences that have that 
structure as their unique lowest-energy stated It has been shown in various model stud- 
ies that structures differ drastically in their designability; a small number of highly des- 
ignable structures emerge with their associated number of sequences much larger than the 
average .0000'EHillll Highly designable structures are also found to possess other protein- 
like properties, such as thermodynamic stability^ fast folding kineticsptZI and tertiary 
symmetry.illi'El These results suggest that there may be a designability principal behind 
nature's selection of protein folds; these small number of folds were selected because they 
are readily designed, stable against mutations, and thermodynamically stable. 

Why are some structures more designable than others? How do we identify highly 
designable structures? Finkelstein and co-workers argued that certain motifs are easier to 
stabilize and thus more common because they either have lower (e.g. bending) energies 
or have unusual energy spectra over random sequences.SlllS Govindarajan and Goldstein 
suggested that the topology of a protein structure should be such that it is kinetically 
"foldable" BEHU More recently, it was noted that an important clue resides in the distribution 
of structures in a suitably defined structure space, with highly designable structures located 
in regions of low density.liHll!J In particular, within a hydrophobic model, Li et al. showed that 
the distribution of structures is very nonuniform, and that the highly designable structures 
are those that are far away from other structures. @ However, identifying highly designable 
structures still remains a tedious task, requiring either full enumeration or sufficiently large 
sampling of both the structure and the sequence spaces, making studies of large systems 
prohibitive. 

In this paper, we investigate the properties of the structure space of the hydrophobic 
model of Li et al, starting from a Principal Component Analysis (PCA). We show that 
while the distribution of the structures is not uniform, it can be approximated as a cloud of 
points centered on a single peak. The principal directions of this cloud are almost coincident 
with those obtained by rotation into Fourier space; the coincidence is in fact exact for the 
subset of cyclic structures. An interesting feature is that the eigenvalues of PCA, describing 
the extent of the density cloud along the principal axis, vary continuously with the Fourier 
label q, with a minimum at q = ir corresponding to alternating patterns. The continuity of 
the eigenvalues suggests an expansion around q = ir, which leads to an analytical conjecture 
for the density of structures in the iV-dimensional binary space. Assuming the validity of 
this conjecture in more general models, it provides a means of estimating density, and hence 
indirectly designability, of structures by simply analyzing their sequences, without the need 
for extensive enumerations of other possible structures. 

The rest of the paper is organized as follows. In Section II we review the hydrophobic 
model and the designabilities of structures. In Section III we discuss the methods and the 
results of PCA applied to the structure space, and relate the density and designability of 
a structure to its projections onto the principal axes. In Section IV we demonstrate that 
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Fourier transformation provides a very good approximation to PCA, and show that in fact 
the two procedures are equivalent for the subset of cyclic structures. As a comparison 
with real structures, in Section V we introduce and study an ensemble of pseudo-structures 
constructed by a Markovian process. Finally, in Section VI we synthesize the numerical 
results of PCA analysis, and develop a conjecture for the density of points in structure 
space. 

II. THE HYDROPHOBIC MODEL 

We start with a brief review of the hydrophobic model of Li et alM and the designabilities 
of structures. Model sequences are composed of two types of amino acids, H and P. Each 
sequence {hi} (for i — 1, 2, • • • , N) is represented by a binary string or vector, with hi = for 
a P-mer and hi = 1 for an H-mer. We take the polymer length N = 36, for which there are 
2 36 sequences. Each of these sequences can fold into any one of the many compact structures 
on a 6 x 6 square lattice (Fig. [3]). There are 57, 337 such compact structures unrelated by 
rotation and mirror symmetries. In the hydrophobic model, the only contribution to the 
energy for a sequence folded into a structure is the burial of the H-mers in the sequence into 
the core of the structure. So if one represents a structure by a binary string or vector, {s^}, 
for i = 1, 2, ■ • • , 36, with = for the surface sites and Sj = 1 for the core sites (Fig. [[]), 
the energy is 

N 

E = -J2h iSi , (1) 

i=i 

where hi is the sequence vector. 

The designability of a structure is defined as the number of sequences that have the 
structure as their unique lowest-energy state. To obtain an estimate for designabilities of 
structures, we randomly sampled 50, 000, 000 sequences and found the unique lowest-energy 
structure, if any, for each of them. In Fig. 0, we plot the histogram of designabilities, i.e. 
number of structures with a given designability. Note that we have normalized designabil- 
ity so that its maximum value of 2981 is scaled to one. In this paper, we define highly 
designable structures to be the top one percent of designable structures (structures with 
nonzero designability), which means 307 structures with a designability larger than 0.47. 

In the hydrophobic model, both sequences and structures can be regarded as points in 
a 36-dimensional binary space, or corners of a hypercube in a Euclidean space of similiar 
dimension. In this representation, the lowest-energy state of a sequence is simply its nearest 
structure point .@ Designabilities can then be obtained by constructing Voronoi polyhedra 
around all points corresponding to structures in this space; the designability of each structure 
is then the number of sequence points that fall within the corresponding Voronoi polytope 
(Fig. [3p. Structures in the lower density regions have larger Voronoi polytopes and higher 
designability. Understanding how the structure points are distributed in this 36-dimensional 
space can thus help us address questions concerning designability. In the next section we 
examine the distribution of the structure points via the method of PCA. 
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III. PRINCIPAL COMPONENT ANALYSIS 



First, let us note that while sequences are uniformly distributed in the 3 6- dimensional 
hypercube, structures are distributed on a 34-dimensional hyperplane because of the follow- 
ing two geometrical constraints. The first constraint on structure vectors comes from the 
fact that all compact structures have the same number of core sites, and thus 

36 

5> = 16 - ( 2 ) 

4=1 

The second constraint is that since the square lattice is bipartite, and any compact structure 
traverses an equal number of 'black' and 'white' points, 

36 

EC- 1 )'* = 0. (3) 

Next, let us define the covariance matrix of the structure space as 

Cij = (siSj) - (si) (sj) , (4) 

where i,j = 1,2, ■••,36, and the average is over all the 57,337 possible (si, S2, • ■ ■ , s^) 
for compact structures. The 36 x 36 covariance matrix is symmetric Cij = Cj^, and also 
satisfies the condition C^j = C^-i^-y The latter is due to the reverse-labeling degeneracy 
of the structure ensemble, since if the string (si, s 2 , ■ ■ • , s 36 ) is in this ensemble, then its 
reverse (s^, S35, • • • , si) is also included. This symmetry implies that if (vi, t> 2 , • • ■ , vsq) is 
an eigenvector of the matrix Cij, then (t> 36 , V35, ■ • • , v%) is also an eigenvector with the same 
eigenvalue. Therefore, for every eigenvector of Cij we have either Vj = or Vj = —v^^j. 

As depicted in Fig. £|, the matrix C^ is peaked along the diagonal and decays off- 
diagonally with short range correlations. This feature reflects a general property of compact 
self-avoiding walks; if a monomer is in the core (on the surface) the neighboring monomers 
along the chain have enhanced probability to be in the core (on the surface). Another char- 
acteristic of Cij is that it is almost a function of \i — j\ only, i.e. Cij ~ F(\i — j\), barring 
some small end and parity effects. We expect this feature of approximate translational in- 
variance to be generic beyond the 6x6 lattice model studied here. We also looked at the 
covariance matrix for the subset of highly designable structures. While qualitatively similar, 
it tends to decay faster off-diagonally than that of all structures. This is attributed to the 
fact that highly designable structures tend to have more frequent transitions between core 
and surface sites.li3'EjE3 

For PCA of structure space, the matrix is diagonalized to obtain its eigenvectors 
{v^}, and the corresponding eigenvalues for k = 1,2, •••,36, which are shown in 

Fig. |5]. The two zero eigenvalues (Ai = A2 = 0) result from the constraints in Eqs. (0) and 
(|), with the corresponding eigenvectors of vf~ = 1, and vf^ = (—1)* for % = 1, 2, • • • , 36, 
respectively. The remaining 34 nonzero eigenvalues range smoothly from zero to one, making 
any further dimensional reduction not obvious. For comparison, the 36 eigenvalues of the 
uniformly distributed points of sequence space are all the same (A = 1/4). (It is easy to 
show that the covariance matrix for the sequence space is = 5y/4.) On the other hand, 
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a uniform distribution on the 34-dimensional hyperplane where the structure points reside 
would result in 34 identical eigenvalues of 360/1377 ~ 0.26.0 

Identification of the principal axes and eigenvalues does not necessarily provide infor- 
mation about the distribution of points in space. To examine the latter, we first project 
each structure vector onto its components along the eigenvectors. Using the rotation matrix 
Rki that diagonalizes the covariance matrix, the component y^ of the structure vector along 
principal axis k is obtained as 



36 

E 

i=l 



(si))R. 



ki • 



(5) 



Interestingly, we find that along each of the principal directions, the distribution of compo- 
nents is a bell-shaped function with a single peak at zero. Such distributions can then be 
well approximated by Gaussians whose variances are the corresponding eigenvalues i.e. 



PkiVk 



1 



(6) 



In Fig. |6] we show the distribution of projections y k on two principal axes k — 16 and k = 36, 
along with the corresponding Gaussian distributions. 

Equation ((^) provides a good characterization of the density of structures in the N 
dimensional space. Highly designable structures are expected to lie in regions of this space 
where the density of structures is small, while the number of available sequences is large. 
Let us consider a structure characterized by a vector y. If the density of structural points in 
the vicinity of this point is p s t r {y), the number of available structures in a volume V around 
this point is Vp str (y). Neglecting various artifacts of discreteness, the volume of the Voronoi 
polyhedron (see Fig. 3) around this point is given by V(y ) ~ l/p s tr(y)- The designability is 
the number of structures within this volume, and estimated as p seq (y)/ Pstr(y), where p se q(jj) 
is the density of sequences. The sequence density is in fact uniform in the N- dimensional 
space. The structure density can be approximated as the product of Guassians along the 
principal projections, and thus 



Designability 



Pseqjy) 

pstr (y) 
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■ 36 

E 

.fe=3 



A 

2\ k 



M(y). 



(7) 



We have neglected various proportionality constants in the above equation, leading to the 
quantity M.{y) which is our estimator for designability. In Fig. [?|, the estimate M. is 
plotted against the actual designability for all designable structures. There is a reasonably 
good, but by no means perfect, correlation between the designability and the estimator Ai. 
The structures with the top one percent value of M. include 39% of the highly designable 
structures. 



IV. FOURIER DECOMPOSITION AND CYCLIC STRUCTURES 

In discussing Fig. |], we already noted that the covariance matrix CV,- is approximately a 
function of \i — j\, with corrections due to end effects. If this were an exact symmetry, the 
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matrix would be diagonal in the Fourier basis. Even in the presence of the end effects, Fourier 
decomposition provides a very good approximation to the eigenvectors and eigenvalues of 
PCA, as demonstrated below. For each structure vector {sj}, the Fourier components are 
obtained from 

1 N ■ ■ 

= -7^ (8) 

V A j=1 

where q = 2na/N, with a = 0, 1, • • • , N — 1. The average value of (sj) is subtracted for 
convenience. With this subtraction, the two constraints in Eqs. (fj) and (^) correspond to 
two zero modes in Fourier space, as So = and S n = 0, and since {sj} are real S* = S- q . 
The covariance matrix in the Fourier space is 

1 N 

(<Vv) = Jj E < : " U "' J ' ( \u- (9) 
i,i'=i 

and is both real and symmetric (since Cjji = Cjij). If Cjj> is translationally invariant, i.e. 
Cjji = F(\j — f \ mod N), Eq. (||) becomes 

(s q sr q/ ) = (io) 

where 

JV-l 

X q =J2e^F(k) = (\S q \ 2 ), (11) 

k=0 

are the diagonal elements of the diagonalized matrix in Eq. (|ToD , and hence the eigenvalues 
of Cjf. Note that because the matrix is real-symmetric, its eigenvalues appear in pairs, i.e. 

\ q = \- g . (12) 

Since our covariance matrix is not fully translationally invariant, (^S q S*,^ is not diagonal. 
However, as shown in Fig. [8]a, its off diagonal elements are very small. As required by 
symmetry, the diagonal elements form pairs of identical values. These diagonal elements, 
plotted versus the index a in Fig. ||b, should provide a good approximation to the eigenvalues 
obtained by PCA. This is corroborated in Fig. ^|a, where we compare (ISJ 2 ) with the true 
eigenvalues of the covariance matrix Cjf. 

Finally, we note that the end effects that mar the translational invariance of the covari- 
ance matrix are absent in the subset of cyclic structures. Any structure whose two ends are 
neighboring points on the lattice can be made cyclic by adding the missing bond. Any one of 
the N = 36 bonds on the resulting closed loop can be broken to generate an element of the 
original set of structures, and the corresponding structure strings are cyclic permutations 
of each other. Thus, the covariance matrix C cyc i ic (j, f) of the set of all cyclic structures 
is translationally invariant. In our model of 6 x 6 compact polymers, there are a total of 
36 x 276 cyclic structures. The Fourier transform of their covaraince matrix is diagonal as 
expected, with diagonal elements depicted in Fig. ||b. The corresponding Fourier eigenvalues 
are quite close to the eigenvalues of the full matrix obtained in the PCA (Fig. |S|b). Thus 
the end effects do not significantly modify the correlations, and this is specially true for the 
smallest eigenvalues which make the largest contributions to the density in Eq. ^. 
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V. A MARKOVIAN ENSEMBLE OF PSEUDO STRUCTURES 



The geometry of the lattice, and the requirement of compactness constrain the allowed 
structure strings of zeros and ones in a non-trivial fashion. In our estimation of designabilities 
so far, we have focused on the covariance matrix which carries information only about two 
point correlations along these strings. In principle, higher point correlations may also be 
important, and we may ask to what extent the covariance matrix contains the information 
about the structures' designabilities? As a preliminary test, we performed a comparative 
study with an artificial set of strings, not corresponding to real structures, but constructed 
to have a covariance matrix similar to true structures on the 6x6 lattice. 

Specifically, we generated a set of random strings {t}, of zeros and ones of length 36, 
using a third order Markov process as follows. For each string, the first element t\ is 
generated with probability P(t\ = 1) = (s\), where (s\) is the fraction of the true structure 
strings with s± — 1. The second element t 2 is generated according to a transition probability 
P(ti — > t 2 ) which is taken to be the "conditional probability" P{s2\Si) extracted from the 
true structure strings. The third point £3 is generated according to a transition probability 
P{t\t2 — > £3) which is the "conditional probability" P{s^\siS2) extracted from the true 
structure strings. All the remaining points tj, j — 4, 5, • • • , 36, are generated according to 
the transition probabilities P(tj_3tj_2tj~i —* tj) equal to the true "conditional probabilities" 
P(sj\sj_3Sj_2Sj-i) of actual structures. Sequences that do not satisfy the global constrains 
of Eqs. (0) and (^) are thrown out. For every Markov string generated, we also put its 
reverse in the pool, unless the string is its own reverse. 

The above Markovian ensemble has a covariance matrix, and corresponding eigenvalues, 



very similar to those of the true structures, as shown in Fig. 10. We then calculated the 



designabilities of these "pseudo-structures" using Eq. ([I]) by uniformly sampling 5 x 10 7 
random binary sequences. The histogram of the designabilities (Fig. [11]) is qualitatively 
similar to that of the true structures (Fig. §). Next we constructed the designability estima- 
tor M. (Eq. (0)) for the pseudo-structures, using the eigenvalues and eigenvectors of their 
covariance matrix. The quantity M. is plotted versus designability in Fig. 12 for all the 
artificial pseudo-structures with non-zero designability. The pseudo-structures with the top 
one percent value of M. include 60% of the highly designable psuedo-structures. 

These results suggest that a considerable amount of information about the designability 
is indeed contained in the two point correlations of the string. The designability estima- 
tor, Eq. (0) in fact does a somewhat better job in the case of pseudo-structures generated 
according to short-range Markov rules. 



VI. CONCLUSIONS 

One of the most intriguingproperties of compact structures, which emerged from early 
extensive enumeration studies,E3 is that designabilites range over quite a broad distribution of 
values. Such a large variation in designability is a consequence of a non-uniform distribution 
of structure vectors, with highly designable structures typically found in regions of low 
density.El However, our study of 6 x 6 lattice structures using PCA indicates that the non- 
uniform density actually has a rather simple form that can be well approximated by a 
single multi- variable Gaussian, as in Eq. (|7]). Since this method of estimating structure 
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designability is based only on the overall distribution of structures, it can be a useful tool in 
cases where there is not enough computational power to enumerate the whole structure space 
and calculate the designability. To obtain an accurate enough covariance matrix requires 
only a uniform sampling of the structure space. 

We can also attempt to use the numerical results as a stepping stone to a more analytical 
approach for calculating the density of structures. First, we note that the covariance matrix 
for all structures is rather similar to that of the subset of cyclic structures, and that for 
the latter PCA is equivalent to Fourier decomposition. Second, we observe that the multi- 
variable Gaussian approximation to structure density in Eq. (|7]) is most sensitive to the 
eigenvalues that are close to zero. In terms of Fourier components, these are eigenvalues 
corresponding to values of q close to tt, and related to the constraint of Eq. (H). There is also 
a zero eigenvalue for q = 0, related to condition (0). However, the latter global constraint 
appears not to have any local counterpart, as there is a discontinuity in the eigenvalues 
close to zero. Third, the continuity of the eigenvalues as q — > tt, along with the symmetry 
of Eq. fljjD, suggests as expansion of the form X q = K(q — tt) 2 + O ((g — vr) 4 ). Indeed the 
numerical results indicate that the important (smaller) eigenvalues can well be approximated 
by K(q - tt) 2 , with K « 0.04.0 

With this approximation, the designability estimate of Eq. ([]) becomes 

N 



M ({s}) « exp 



E 



\Sq\ 



2 

L q 



2K(q-Tr) 



exp 



(13) 



The first form in the above equation expresses the estimate in terms of the Fourier modes 
of the structure string, while the second term is directly in terms of the elements {si}. The 
function Jn (\i — j\) is the discrete Fourier transform of 1/q 2 , which for large N behaves as 
\i— j\. Equation (|T3|) is thus equivalent to the Boltzmann weight of a set of unit charges on a 
discrete line of N points marked by parity. The charges on the sublattice of the same parity 
attract each other with a potential J/vr(r), while those on different sublattices repel. Such 
an interaction gives a larger weight (and hence designability) to configurations in which the 
charges alternate between the core and surface sites, as observed empiricallyJllllli! 

In would be revealing to see how much of the above results, developed on the basis of 
a lattice hydrophobic model, can be applied to real protein structures. One could use the 
exposure level of residues to the solvent in building up the structure vectors. Current meth- 
ods deal with structure strings of a fixed length, equal to the dimension of the structure 
space. Since real proteins have different lengths, there is a need for a scaling method to 
handle them all together. Our study shows that the two point correlations of structure vec- 
tors are approximately translationally invariant, and can be captured by Fourier analysis. 
This suggests the possibility of casting the density of points in structure space in universal 
functional forms dependent only of a few parameters encoding the properties of the under- 
lying polymers. If so, it would be possible to provide good estimates for designability with 
polymers of varying length, without the need for extensive numerical computations. 
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FIGURE CAPTIONS 



1. A possible compact structure on the 6x6 square lattice. The 16 sites in the 
core region, enclosed by the dashed lines, are indicated by l's; the 20 sites on 
the surface are labeled by 0's. Hence this structure is represented by the string 
001100110000110000110011000011111100. Note that each 'undirected' open geometri- 
cal structure can be represented by two 'directed' strings, starting from its two possible 
ends (except for structures with reverse-labeling symmetry where the two strings are 
identical). It is also possible for the same string to represent different structures which 
are folded differently in the core region. For the 6x6 lattice of this study, there are 
26929 such 'degenerate' structures, which are by definition non-designable. 

2. Number of structures with a given designability versus relative designability for the 
6x6 hydrophobic model. The data is generated by uniformly sampling 5 x 10 7 strings 
from the sequence space. The designability of each structure is normalized by the 
maximum possible designability. 

3. Schematic representation of the 3 6- dimensional space in which sequences and struc- 
tures are vectors or points. Sequences, represented by dots, are uniformly distributed 
in this space. Structures, represented by circles, occupy only a sparse subset of the 
binary points and are distributed non-uniformly. The sequences lying closer to a par- 
ticular structure than to any other, have that structure as their unique ground state. 
The designability of a structure is therefore the number of sequences lying entirely 
within the Voronoi polytope about that structure. 

4. Covariance matrix CV, of all compact structures of the 6x6 square. 

5. Eigenvalues of the covariance matrix for the structure vectors (circles), and for all 
points in sequence space (crosses). 

6. Distributions of projections y& onto principal axes k = 16 (a), and k = 36 (b), for all 
57337 structures (dots). Also plotted are Gaussian forms with variances Ai 6 and A 36 , 
respectively (dashed lines). 

7. The estimate M. (Eq. (|7|)) versus scaled designability for all designable structures on 
the 6x6 square. 



8. (a) The Fourier transformed covariance matrix (^S q S*,^ (Eq. ([])); and (b) its diagonal 
elements {\S q \ 2 ). 

9. (a)The diagonal elements ((S^l 2 ) (dots) plotted together with the eigenvalues of the 
covariance matrix (pluses), (b) Diagonal elements of the Fourier transformed C C y C u c , 
which are also the eigenvalues of the covariance matrix of cyclic structures (pluses). 
Eigenvalues of the covariance matrix for all structures are indicated by stars. 

10. Eigenvalues of the covariance matrix for the structures generated by the Markov model 
(circles), and that of the true structure space (pluses). 



11 



11. Number of pseudo-structures with a given designability versus designability for the 
pseudo-structure strings randomly generated using the Markov model. The data is 
generated by uniformly sampling 5 x 10 7 binary sequence strings. The designability of 
each pseudo-structure is normalized by the maximum possible designability. 

12. The quantity M. versus designability for all designable pseudo-structures generated by 
the Markov model. 
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FIG. 2. Yahyanejad, et al. 



14 




FIG. 3. Yahyanejad, et al. 
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FIG. 4. Yahyanejad, et al. 
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FIG. 5. Yahyanejad, et al. 
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FIG. 6. Yahyanejad, et al. 
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FIG. 7. Yahyanejad, et al. 
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FIG. 8. Yahyanejad, et al. 
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FIG. 9. Yahyanejad, et al. 
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FIG. 10. Yahyanejad, et al. 
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FIG. 11. Yahyanejad, et al. 
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FIG. 12. Yahyanejad, et al. 
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